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Abstract 

-1 • From a logic point of view this is the third in the series to solve the problem of absence of detailed 

• i— i | 

^O , balance. This paper will be denoted as SDS III. The existence of a dynamical potential with both 

local and global meanings in general nonequilibrium processes has been controversial. Following 

an earlier explicit construction by one of us (Ao, J. Phys. A37, L25 '04, cond-mat/0803.4356, 

referred to as SDS II), in the present paper we show rigorously its existence for a generic class 



CO 

o 



of situations in physical and biological sciences. The local dynamical meaning of this potential 



function is demonstrated via a special stochastic differential equation and its global steady-state 

o ; 

meaning via a novel and explicit form of Fokker-Planck equation, the zero mass limit. We also 
O ■ 

give a procedure to obtain the special stochastic differential equation for any given Fokker-Planck 

• i— i , 

equation. No detailed balance condition is required in our demonstration. For the first time we 
obtain here a formula to describe the noise induced shift in drift force comparing to the steady state 
distribution, a phenomenon extensively observed in numerical studies. The comparison to two well 
known stochastic integration methods, Ito and Stratonovich, are made ready. Such comparison 
was made elsewhere (Ao, Phys. Life Rev. 2 (2005) 117. |q-bio/060 5020). 

(Please cited present paper as Existence and Construction of Dynamical Potential in Nonequi- 
librium Processes without Detailed Balance, L. Yin and P. Ao, J. Phys. A39 (2006) 8593-8601. 
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I. FORMULATION OF THE QUESTIONS 

A large class of nonequilibrium processes can be described by the following stochastic 
differential equation [l|, [2j, y, IJ] : 

q = f(q)+JV 7 (q)f(£), (1) 

where f and q are n-dimensional vectors and f a nonlinear function of q. The noise £ is 
a standard Gaussian white noise with I independent components: (&) = 0, ((,i(t)£,j(t')) = 
5ij5(t — £'), and 2, j = 1,2, ...,/. Even in situations that Eq.flT]) is not an exact description, 
it may still serve as the first approximation for further modelling |3j, |4|. 

A further description of the noise in Eq.([T]) is through the n x n diffusion matrix -D(q), 
which is defined by the following matrix equation 

W/(q)iVJ(q)=2e£>(q), (2) 

where Nj is an n x I matrix, Nj is its the transpose, and e is a nonnegative numerical 
constant playing the role of temperature. This relation suggests that the n x n diffusion 
matrix D is both symmetric and nonnegative. For the dynamics of state vector q, all that 
is needed from the noise is the diffusion matrix D. Hence, it is not necessary to require the 
dimension of the noise vector £ to be the same as that of the state vector q. This implies 
that in general I ^ n. The difficulty for finding such potential function can be illustrated 
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by the fact that usually D _1 (q)f (q) cannot be written as a gradient of scalar function 
when no detailed balance condition is assumed in Eq.(l). Here and below, without lost of 
generality the functions, such as f(q) and -D(q), are assumed to be sufficiently smooth. The 
boundary conditions will be chosen accordingly. This means that boundary conditions such 
as absorbing type will not be considered here, though they can be treated as appropriate 
limits of the smooth functions. 

During the study of the robustness of the genetic switch in a living organism [5|, it was 
discovered that Eq.(l) can be transformed into the following form, 

[S(q) + T(q)]q = -V q 0(q) + N n (q)Z(t) , (3) 

where the noise £ is from the same source as that in Eq.(l). The n x n matrices are the 
symmetric non-negative friction matrix S and the antisymmetric matrix T, and 

S(q)+ r( q H |g(q) ; g(q)] S M( q ). (4) 
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Here Q is an antisymmetric matrix determined by both the diffusion matrix -D(q) and the 
deterministic force f(q) [g, [7|. The potential function 0(q) is connected to the deterministic 
force f (q) by 

V q 0(q) = -M(q)f (q) . (5) 

The friction matrix 5(q) is defined through the following matrix equation 

Nn^NJM) = 2e S(q) , (6) 

which guarantees that S is both symmetric and nonnegative. For simplicity we will assume 
det(S) 7^ in the rest of the paper. It is a sufficient condition for det(M) ^ and more 
general cases are also known J6(. The breakdown of the detailed balance condition or the 
time reversal symmetry is represented by the finiteness of the transverse matrix T. The 
usefulness of this formulation is already manifested in the successful solution of outstanding 
stability puzzle along with new predictions in gene regulatory dynamics 5j. 

It was heuristically argued by one of us |7(] that the global steady-state distribution p(q) 
in the state space is, if it exists, 

p(q) « exp (_43>) . (7) 

By construction the fixed points of the deterministic force f in Eq.(l) are also the extremal 
points of the potential function <p in Eq.Q and ([7|). Therefore, the potential function 
<p acquires both the local dynamical meaning through Eq.([3]) and the global steady-state 
meaning through Eq. (JTI). This heuristical demonstration has been rigorously shown to be 
locally valid for any fixed point, stable or unstable [6]. Two major questions, however, 
remain unanswered: Can the heuristical argument be translated into an explicit procedure 
such that there is an explicit Fokker-Planck equation whose steady state solution is indeed 
given by Eq.([7|)? Is the converse also true, that is, for a given Fokker-Planck equation, can 
the corresponding Eq.([3]) be found? Furthermore, are there new and significant results? In 
this paper we give affirmative answers to all those important questions: The general stage 
is set in Section II; The answer to the first question is given in section III; The awswer to 
the converse question is given in Section IV; and new and significant results are discussed 
in Sections III-V. 



II. DERIVATION OF A GENERALIZED KLEIN-KRAMERS EQUATION 



Central in the heuristical argument is the introduction of an n-dimensional kinetic mo- 
mentum p along with a mass m. This procedure brings the stochastic differential equations 
in close contact with the Hamiltonian or symplectic structure central in theoretical physics. 
The mass would eventually be taken to be zero to recover Eq.([3]). The dynamical equation 
for the enlarged state space is now In dimensions and the extended stochastic dynamical 
equation takes the form [7(] 



q 
p 



_p 

m 



P 



-M(q)^-V q 0(q)+iV // (q)e(i) 



m 



(8) 



which is in the form of the standard Langevin physics in the (p, q) phase space. A similar 
equation has been extensively studied in literature J3, |4|. Here, we investigate it from a 
different perspective, the zero-mass limit. 

To proceed, we first give an independent derivation of the generalized Fokker-Planck 
equation, the so-called Klein-Kramers equation 3j in a general form, corresponding to Eq.flBJ). 
We will show that there is no ambiguity in the treatments of stochastic differential equation 
at this stage. The probability distribution function in the (p, q) phase space is defined by 

p(p, q, t) = (5(p - p(t, {£}))<*(q - q(t, {£}))> , (9) 

where q(t, {£}) and p(t, {£}) are the solution of Eq.® for a given noise configuration {£}. 
The distribution function p is obtained by averaging over all the noise configurations, which 
is an ensemble average. 

With variables (q(t),p(t)) following Eq.fjHJ), the time derivative of the distribution func- 
tion p is given by 



d t p(p,<l,t) = Vj 



P 



M(q)-^ + V q 0(q) 



m 



P 



p(p,q,*) - v q - — p(p,q,t) 



m 



-V p .JV M (q)(e(t)%-q)(J(p-p)). 

Using an identity due to Novikov 8], 

where g is a functional of the noise {£}, and using the convention 



fmdt 

Jo 



/m = 1/2 



(10) 



(ii) 



(12) 



and noting that the solution of Eq.(JHD can be formally expressed as 

q(t) - q(0) = / pdt'/m (13) 

Jo 

p(t) - p(0) = - f [M(q)p/m - V q 0(q) + N n (q)Z] dt' , (14) 

Jo 

we have the following relations 

5q(t)M(t) = 0, (15) 

6p(t)/6Z(t) = NJM/2. (16) 

The last term in right hand side of equation (TTOj) is thus given by 

-Vp-iMq)<£(0%-q)5(p-p)> = V p -iV // (q)iiV7 / (q)V p p(p,q,t), (17) 

Combining Eq. fllOl) and (TT7|) . we obtain the Klein-Kramers equation, a special form of 
the Fokker-Planck equation, 



d t p(p,q,t) 



M(q)P +V q 0(q) + e5(q)V p 
m 



p(p,q,t)-V q -^-p(p,q,t). (18) 
m 



A special case of Eq. ffTB"]) has been known [3J. Here we have generalized it to any allowed 
matrix M. It has the stationary solution, if it exists, 



,;2 



pM = ew Llk±m\ (19) 

which holds for all possible values of mass m. 

We should point out that starting from Eq.® same Eq. ffTB"]) can be arrived by either 



Ito or Stratonovich prescription of stochastic integration, because V p M(q) = 0. Eq.(19) 
has been used in the heuristic demonstration [7J], to make use of its insensitivity to various 
treatments of stochastic differential equation. 



III. ZERO-MASS LIMIT AND THE DESIRED FOKKER-PLANCK EQUATION 

Now we are ready to take the zero-mass limit and to derive the Fokker-Planck equation 
corresponding to Eq.fJS]). We first define following two operators: 

P 



U = VIM(q 



eV p + 

m 



(20) 



L 2 = -£ • V q + V q 0(q) • V p . (21) 

fit 



With those two operators, Eq. (TT8l) becomes 



d t p{p, q, t) = (Li + L 2 )p(p, q, t) 



(22) 



The antisymmetric properties V p T(q)V p = and p T T(q)p = are used in above equation. 
There are various ways to eliminate the fast degrees of freedom of q implied in the zero- 
mass limit, such as the dynamical renormalization method 9j and the projection operator 
11 1 . In the following, we adopt from Gardiner [4j the standard projection 



method 
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operator method for its conciseness. For further exposition of this method, we refer readers 

toRef.|lo|,[ll|. 

Following Gardiner, we introduce a projection operator 



Ph(p,q,t) = 



1 



exp 



P 



2me 



h(p',q,t)d n p' 



(2irme) n / 2 
where h is an arbitrary function of p, q. 

The eigenvalues of the projection operator can only be zero or one, 



(23) 



P 2 = P, 



(24) 



which follows from the relation 

1 



P 2 h(p,q,t) 



(27rme) n / 2 

1 
(27rme) n / 2 
Ph(p,q,t). 



cxp 
exp 



P 



2me / 
-3 N 



d n pi 



cxp 



Pi 



P 



2me 



(27rme) n / 2 
h(p',q,t)d n p' 



2rae 



h(p 2 ,q,t)d n p 2 



From the fact 



*' m) \ 2me 



(25) 



(26) 



we obtain the identity 



L X P = 0. (27) 

Since L\ is a total derivative operator, for any function h(p, q, t) that is well behaved at the 
boundary (infinity), the function PL\h(p,q,t) vanishes, because 



PLifc(p,q,i) 



1 



(2yrme) n / 2 

1 
(2vrme) n / 2 
0, 



cxp 



exp 



P 



2rae 

■2 



eV p / + - 

m 



V;,M(q 
|_)£_ dS .V^ (q ) 



h(p',q,t)d n p 



eV p ,+ 



m 



h(p',q,t) 



where dS is the surface element with direction. From the last two identities, we can see that 
the operator L\ is orthogonal to the projection operator P. We further have PL 2 P = , 
due to the inversion symmetry in the p-space, 

/ jSrr^-l ■ v * + v ^ (q) ' v -i exp (-£) = °- (28) 

To proceed, we first separate the distribution function into the projected part v(p, q, t) = 
Pp(p, q, i) and unprojected part w(p, q, t) = (1 — P)p(p, q, t). We further define the reduced 
distribution function p(q, t) through the projected part: 



The dynamical equations for t> and tu can be obtained separately from Eg. (1221) 

d t v = P8 t p = P(Li + L 2 )(v + w) = P^ 2 ^ , (30) 

(9 4 w = d t p — Pd t p = {L\ + L 2 )w + L 2 v — PL 2 w . (31) 

After the Laplace transformation h(s) = f£° h(t) exp(—st)dt , these two equations take the 
form sv — v(0) = PL 2 w and sw — w(0) = {L\ + L 2 )w + L 2 v — PL 2 w. The latter expression 
is equivalent to 

w=[s-L 1 -(l- P)L 2 ]- l [L 2 v + w(0)] . (32) 

We note that following Eq. (jSJ) the relaxation time for p dynamics is of the order of m. In 
the zero-mass limit, this relaxation time is very short. After sufficiently long time, that is, 
t » m, which is still short comparing to the dynamics of the q, the momentum distribution 
is essentially described by the white noise and its fluctuation range is order of \Jm. Its mean 
distribution would be determined by the slow dynamics of q. Therefore we are looking for 
the low frequency behavior of the transformed equation: the leading contribution when 
s << 1/m. At low frequency, to the leading order of m, the momentum p scales with \/m, 
Li is of the order of 1/m, and L 2 is of the order of 1/ y/m. Hence, at low frequency to the 
leading contribution ordered by m, Eq. fl32|) leads to 

w = -L\ x L 2 v + 0{m) , (33) 

which is a precise statement on the adiabatic following of kinetic momentum p to the 
coordinate q. The equation for v is thus given by 



dtv = -PL 2 L^L 2 v + O(v^) • (34) 



We recall an identity to be used. The operator L\ has a null space and its inverse operator 
is not well defined unless in the space orthogonal to the null space. For an arbitrary vector 
c(q) which has no p-dependence, the following identity holds 



Lip • c(q) exp f 


P 2 \ 
2me J 


= eV p • M(q)c(q) exp 

= • M (q)c(q) exp 

m 



p 2 



2me 

■2 



— ) • (35) 

2me) V ; 

We note that L 2 v takes the form of the right hand side of Eq. (1351) , and is therefore orthogonal 

to the null space of L\, The inverse operator Lj" 1 is then well defined. Using the inverse 

relation of Eq. (|35l) we arrive at the desired identity: 



^■^^{-£)=- p ' M - l ^^4-^) ■ (36) 



With above identity, the right hand side of Eq. flMj) is given by 

- PL 2 L^L 2 v = PLa^r 1 - ■ [V q + -V q 0(q)]v 

= Vq-M-^^feVq + V^q)]^. (37) 

Therefore in the zero- mass limit, m — > 0, the equation for the integrated probability 
distribution p(q, t) defined in Eq. (l29|) takes the form, as a direct consequence of Eq.( 1M|) and 

(EZD 

d t p(q,t) = VqM- 1 (q)[eVq + V q 0(q)]p(q,t) . (38) 

This is the sought Fokker-Planck equation corresponding to Eq.([3]). We point out that in 
the above derivation we take the mass to be zero, keeping other parameters, including the 
friction and transverse matrices, finite. On the other hand, in the usual Smoluchowski limit 
it is the friction matrix that has to be taken as infinite, keep all other parameters finite. 
Those two limits are in general not interchangeable. 

The equilibrium configuration solution of Eq. fl38|) is the same as Eq.(J7|). Again, we em- 
phasize that no detailed balance condition is assumed in reaching this result. This completes 
our answer to the first question of finding the corresponding Fokker-Planck equation. 

IV. CONVERSE PROBLEM 

We now address the second main question that for any given Fokker-Planck equation 
there is the corresponding stochastic differential equation, Eq.Q. We will give an affirmative 
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answer, which closes a logic gap in the light of present formulation. The procedure to carry 
it out is already implicitly contained in Eq. fl38|) . a typical situation in theoretical physics 
that if the answer is known a procedure to obtain it can be easily found. In addition, the 
demonstration in this section also supplements above rather abstract projection operator 
demonstration. 

A generic Fokker-Planck equation for the dynamics of probability density in state space 
may take the form: 

d t p(q, t) = V;[eD(q) V q - f (q)]p(q, t) . (39) 

Here -D(q) is the diffusion matrix and f (q) the drift force. A potential function 0(q) can 
always be defined from the steady state distribution. This has been extensively studying in 
mathematics 12] . Given the existence of the potential function, the procedure is particularly 
simple. 

Using M _1 (q) = D(q) + Q(q) [3], Eq.([3H]) can be rewritten as 

d t p(q, t) = V q [ Cj D(q) V q - e(V q Q(q)r + [D(q) + Q(q)] V q 0(q)]p(q, t) . (40) 

The antisymmetric property of the matrix Q(q) has been used in reaching Eq.plfl). Thus, 
comparing between Eg. ( 1391) and ( 1401 . we have -D(q) = -D(q) , 0(q) = 0(q) , and 

f(q) = f(q) - e(V q Q(q)) r ■ (41) 

In reaching Eq. (l4T1) we have used the relation [-D(q) + <5(q)]V q 0(q) = — f(q). The explicit 
equation for the anti-symmetric matrix Q is 

- e(V q Q(q)) T + [D(q) + Q(q)]V q 0(q) = -f(q) . (42) 

The solution for Q can be formally written down 
Q(q) = -^ V[f(q')+^(q')V q ^(q')]exp ( ^ ~ M \ + g o(q) exp L^-\ . (43) 

Here Qo(q) is a solution of the homogenous equation eV q Q(q) = and the two parallel 
vectors in the integrand, such as dq' f (q), forms a matrix. This completes our answer to the 
converse question of finding the corresponding stochastic differential equation in the form 
of Eq.([n]) from any given Fokker-Planck equation. 

We note that the shift between the zero's of the potential gradient and the drift force is 
given by, from Eg. (1411) . 

Af = - e (V q Q(q)r, (44) 



that is, the extremals of the steady state distribution are not necessarily determined by the 
zero's of drift force f . To our knowledge this is the first time that such an analytic formulae 
for the shift is obtained. 

It is worthwhile to point out that a construction similar to that of above was discussed in 
Ref. [13(. In order to obtain the desired potential function, several additional conditions, in- 



cluding one similar to set V q Q(q) = (their (4.18)), were required in Ref. [13|. Our present 



demonstration shows that there is no need for those conditions. Hence, our construction 



may be regarded as a generalization of the corresponding one in Ref. 131 ]. 



V. DISCUSSIONS 

Attempts to decompose the dynamics into the dissipative and transverse par ts were exten- 
sively explored in literature in the framework of Fokker-Planck equation |14j . Il5j |. Though 
conceptually the basic ideas in literature are similar to what discussed here, the present 
demonstration shows that in general there is no apparent separation between the friction 
and the transverse matrices implied in those previous works, because the gradient of the 
antisymmetric matrix Q in Eq.(41) is in general not zero. The anti-symmetric matrix Q 
should be determined by both diffusion matrix D and deterministic force f in Eq.(l), or, 
by both friction and transverse matrices in Eq.([3]). Furthermore, the connection between 
the local micro-dynamics describing by Eq.([3]) and the global macro-dynamics discussed in 
Eq.(41), or Eq.(42) or (43), was not discussed in Ref.[14l. Il5|. In fact, the present authors 
did not aware such a connection prior to 2004 p, |7| . We should remark here that the special 
form of the stochastic differential equation, Eq.([3]), is consistent with the formulation of 
dissipative dynamics from first principles [10, ll6( • 

If the antisymmetric matrix Q is zero, there would be no shift between the zero's of drift 
force and the potential gradient according to Eq.( l38l and ( 1391) . The drift force in this case 
can be expressed as f (q) = — D(q)V q 0(q), exactly the detailed balance condition. However, 
even if D is independent of the state vector, that is, there is no difference between Ito and 
Stratonovich treatments of stochastic differential equations, the anti-symmetric matrix Q 
can still be state vector dependent. There would still be a shift between the zero of the 
potential gradient and the drift force. This is precisely what have been found in numerical 
studies on noise induced phase transitions and bifurcations [171 ] . Eg. (1441) is a formula for 
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this shift, which appears for the first time in the present letter. 

There is an apparent disagreement between the singular behaviors found in the escape 



path study [18|, [19| and a possible smooth potential function implied in the present study. 
While a detailed study on this feature is beyond the present letter, which will be reported 
elsewhere, we point out two main factors which are responsible for this apparent disagree- 
ment. The first factor is the difference in specifying the stochastic integration procedures. 
This difference results in a shift between the zeros of drift force and extremals of the steady 
steady distribution, described by the shift formula, Eq. fllH) . The second factor is that in 

n n 

Ref. [18J and [19J the focus is on the escaping rate and the corresponding escaping path, 
not on the steady state distribution. The emergence of singularity is then not surprising, 
because its sensitivity to the dynamical elements, the transverse matrix T and the friction 
matrix 5*, in additional to the noise strength specified by e. 

Finally, there is another immediate and testable prediction from the present formulation. 
The limit cycle dynamics, abundant in nonequilibrium processes, has been used as a proto- 
type example to argue against the existence of potential function. Not only our formulation 
suggests its existence in the sense of Eq.((3]), ([7]), and ( |38|) . which is natural in theoretical 



physics, also it should take the same value along the limit cycle 20j. 
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